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Abstract — In this paper, we present a fast min-sum algorithm 
for decoding LDPC codes over GF{q). Our algorithm is different 
from the one presented by David Declercq and Marc Fossorier 
in [1] only at the way of speeding up the horizontal scan in 
the min-sum algorithm. The Declercq and Fossorier's algorithm 
speeds up the computation by reducing the number of config- 
urations, while our algorithm uses the dynamic programming 
instead. Compared with the configuration reduction algorithm, 
the dynamic programming one is simpler at the design stage 
because it has less parameters to tune. Furthermore, it does not 
have the performance degradation problem caused by the con- 
figuration reduction because it searches the whole configuration 
space efficiently through dynamic programming. Both algorithms 
have the same level of complexity and use simple operations 
which are suitable for hardware implementations. 

I. Introduction 

LDPC (low density parity check) codes are the state of art 
technology [2], [3] for their near Shannon limit performance 
for channel error correction [4]. China has considered it for 
broadcasting digital video for terrestrial televisions. Europe 
has accepted for its next generation broadcasting digital video 
using satellites (DVB-S2). LDPC codes have also accepted or 
considered by many industry standards such as IEEE 802.16 
and IEEE 802. lln. The LDPC codes defined over Galois 
field GF{q) of order q > 2 have shown significant improved 
performance over binary LDPC codes. 

David Declercq and Marc Fossorier presented in [1] a fast 
min-sum algorithm for decoding LDPC codes over GF{q). It 
is a generalization of the normalized/offset min-sum algorithm 
from the Galois field GF{2) [2], [3] to any Galois field, 
GF{q) for any q > 2. The Declercq and Fossorier's algorithm 
has much less complexity than another generalization of the 
min-sum algorithm given in [5]. Their algorithm speeds up 
the computation by reducing the number of configurations 
evaluated at the horizontal scan of the min-sum algorithm. 

In this paper, we present another min-sum algorithm which 
different from the Declercq and Fossorier's one only at the 
horizontal scan. We use the dynamic programming technique 
to speed up the horizontal scan instead of reducing the 
number of configurations. Both techniques have the same 
level of complexity. The latter finds approximate solutions at 
the horizontal scan which may introduce some performance 
degradation, while the former finds exact solutions and does 
not cause any performance degradation. The former is also 



simpler to design because it does not need to tune the balance 
between the configuration reduction and performance. 

II. Generalized Min-Sum Algorithms for 
Decoding LDPC Codes over GF{q) 

A. The Problem Statement 

LDPC codes belong to a special class of linear block codes 
whose parity check matrix H has a low density of ones. For 
a LDPC code over GF{q), its parity check matrix H has 
elements hmn defined over GF{q), hmn £ GF{q). Let the 
code word length be N (the number of symbols), then H 
is a M X N matrix, where M is the number of rows. Each 
row of H introduces one parity check constraint on input data 
X = {xi,X2, . . . ,xn), i.e., 

N 

hmnXn = 0, for m = 1, 2, . . . , M . 

Putting the rn constraints together, we have Hx^ = 0. 
Let function /„(a;„) be defined as 

fnixn) = -lnp(a;„/j/„) , 

where p(a;„/y„) is the conditional distribution of input data 
symbol n at value Xn given the output data symbol n at value 
Vn- /n(0) -/„(a:„), which is equal to ln(p(a;„/y„)/p(G/y„)), 
is the log-likelihood ratio (LLR) of input data symbol n at 
value Xn versus value 0. 

In those notations, the maximum likelihood decoding can 
be formulated as a constrained optimization problem, 

n 

min \^ fn{xn) s.t. (subject to) Hx'^ = . (1) 

n=l 

The above function is called the objective function for decod- 
ing a LDPC code. The decoding problem is, thus, transferred 
as finding the global minimum of a multi-variate objective 
function. 

Let X be the set of all variables. Given the mth constraint be 
Hjnx'^ — 0, let X„i be the subset of variables corresponding 
to the non-zero elements in i7,„, i.e.. 



Let fx„S^m) be a function defined over Xm as 

0, if HrnX^ = 0; 



oo, otherwise. 



fx^{Xm) is called the constraint function representing the 
TOth constraint. Using the constraint functions, the decoding 
problem Q can be reformulated as a unconstrained com- 
binatorial optimization problem of the following objective 
function, 



M 



N 



(2) 



B. Generalized Min-Sum Algorithm for LDPC over GF{q) 

Dr. Wiberg [6] developed the min-sum algorithm as a gen- 
eralization of the Viterbi algorithm. The min-sum algorithm 
is also proposed in [7] as an approximation to the belief 
propagation (BP) algorithm [8], [9]. It is also referred to as the 
BP-based algorithm. The min-sum algorithm is a soft-decision, 
iterative algorithm for decoding binary-LDPC codes. 

Conventionally, a LDPC code is represented as a Tanner 
graph, a graphical model useful at understanding code struc- 
tures and decoding algorithms. A Tanner graph is a bipartite 
graph with variable nodes on one side and constraint nodes 
on the other side. Edges in the graph connect constraint 
nodes to variable nodes. A constraint node connects to those 
variable nodes that are contained in the constraint. A variable 
node connects to those constraint nodes that use the variable 
in the constraints. Constraint nodes are also referred to as 
check nodes. During each iteration of the min-sum algorithm, 
messages are flowed from variables nodes to the check nodes 
first, then back to variable nodes from check nodes. 

Let M{m) be the set of variable nodes that are connected to 
the check node m. Let M.{n) be the set of check nodes that 
are connected to the variable node n. Let symbol '\' denotes 
the set minus. M{m) \ n denotes the set of variable nodes 
excluding node n that are connected to the check node m. 
M{n) \ m stands for the set of check nodes excluding the 
check node ni which are connected to the variable node n. 

The generalization of the min-sum algorithm for decoding 
LDPC codes over GF{q) is straightforward. At iteration k, 
let Zmn{xn) denote the message sent from variable node n to 
check node m. Zm^(O) — Zmn{xn) is the log-likelihood ratio 
(LLR) of the n-th input symbol having the value x„ versus 
0, given the information obtained via the check nodes other 
than check node m. Let Lmn(a;n) denote the message sent 
from check node m to variable node n. Lmliixn) is the log- 
likelihood ratio that the check node m is satisfied when input 
symbol n is fixed to value versus value x„ and the other 
symbols are independent with log-likelihood ratios. 



'(0) 



' (a;„), n G jV{rn) \ n. 



The pseudo-code of the generalized min-sum algorithm for 
decoding LDPC over GF{q) is given as follows. 
Initialization 



For n = 1, 2, . . . , iV, and m = 1, 2, . . . , M, 

Iteration (k = 1, 2, 3, . . .) 

1) Horizontal scan 

Compute Lmn{xn), for each Xn G GF{q), 

LiHix^) ^min^ Yl ^tn'^^M (3) 

n eJ\f(m)\n 

S.t. ^ ^ ^mn'-'^n' ~ ^ ' 

n' eAf(m) 

Normalize Lmn{xn) 

For each m, and each n e N{m), offsetting Lm]i(a;„) 
by L^l(O), 

2) Vertical scan 

For n = 1,2, ... ,7V, 

Z^^I{X^) = fn{x^) + E 

3) Decoding 

For each symbol, compute its posteriori log-likelihood 
ratio (LLR) 

Z^^\xn) = fn{Xn) + E ^^'iC^^")- (5) 
m£A4(n) 

Then estimate the original codeword x'^^\ 



^(fc) 



argmin2^''^(a;„), for n = 1, 2, . . . , iV 



If H {x'^^^y = or the iteration number exceeds some 
cap, stop the iteration and output i^*^' as the decoded 
codeword. 

In the above algorithm, zIi\q) — zi^\xn) is the posteriori 
LLR for variable x„ at iteration k. 

One way to possibly improve the performance of the gener- 
alized min-sum algorithm is to modify the Eq. and Eq. ^ 

as 

Z^liXn) ^ fniXn) + ak E -^m'n^^")' 
m GA4(n)\m 

where is a scaling constant at iteration k satisfying < 
ttfe < 1. With these modifications, the decoding algorithm is 
called the normalized min-sum algorithm. 

Another way to possibly improve the performance is to 
modify the Eq. © and Eq. (|5} as 

Z^rHl^^n) = fn{Xn) + E max(L^,) Ja;„ ) - 0) , 
m £A^(n)\m 

Z^^\xr,) ^ fn{xn) + E niax(LW(a;„)-/3fe,0) , 



where (3k is an offset constant at iteration k satisfying Pk > 0. 
With these modifications, the decoding algorithm is called the 
offset min-sum algorithm. 

To possibly maximize the decoding power, the scaling factor 
ttfc or the offset constant f3h can be determined through 
experiments or the density evolution method [10]. 

C. Horizontal Scan via Dynamic Programming 

Our algorithm for the horizontal scan is based on dynamic 
programming [11], which is, in principle, similar to the Viterbi 
algorithm [12] for decoding convolutional codes. It is a linear 
complexity algorithm for the minimization problem defined 
in as long as all x„s are in finite domains. For decoding 
LDPC codes over GF{q), all variables are defined in GF{q), 
a finite domain. The algorithm is applicable for this special 
case. 

With loss of generality, we explain the dynamic program- 
ming algorithm with the assumption of hmn ^ for all ris 
to simpUfy notations. When some of elements hmn& are zero, 
we can apply the same algorithm simply on those variables 
with non-zero coefficients hmn in the parity check constraint 

To simplify notations further, we define as 

The minimization problem defined in (|3} can be rewritten in 
a more succinct form 

N N 

Ltii^n) = min ^ 9n'{xn')^ s.t. h^^,x,^, ^ 0. (6) 

X\Xn — ^ 

n —1 n —1 

We need to solve the minimization problem (|6} N times, 
one for each Xn, n — 1, 2, . . . , iV. This task can be done 
through two scans, each scan defines a dynamic programming 
process. One scan is started from variable xi and ended at 
variable a; at, so called the left scan. The other has the reverse 
order, from xjv to xi, so called the right scan. 

Each scan has — 1 steps, step n — 1, 2, . . . , TV — 1. We 
take the left scan as the case study. The right scan can be 
derived simply by reversing the order of variables. 

For the left scan, at step n, we use variable s„, s„ e GF(q), 
to represent the result of the following summation. 



n'=l 

Also, we assign a real value r-^(s„) for each state s„, which 
stores the result of the following constrained optimization 
problem, 

n n 

r^(s„)= min V5„'(a;„') s.t. V = s„ , 

Xi,...,Xn ^ ^ ^ ^ 

n —1 n —1 

where the superscript "L" stands for the left scan. 
When n = 1, rf (si) is initialized as 

riisi) =5i(/imiSi) . 



At each step n, n — 2,3, . . . , N —1, the dynamic programming 
computes ^^(sn) for each state s„, s„ G GF{q), as follows 

''^nisn) = min gn{Xn) + r^_i{Sn-l) (7) 

Xn-Sn — 1 

s.t. ^n— 1 ~t~ hjYijiXyi — , 

Similarly, for the right scan, when n — N, r^{si) is 
initialized as 

We compute r^(s„), for n = — 1, — 2, . . . , 2, as follows 

"Tnisn) = min gn{Xn) + r^+i{Sn+l) (8) 

X„,Sn + l 

s.t. Sn-\'l ~t~ hfjijiXfi — Sfi , 

We can obtain the minimization result for (|6j from r-^(s„) 
and r^'{sn) directly. For 1 < n < iV, we have 

Ll^lixn) = min r,^_i(s„_i)+r,f+i(s„+i) (9) 

s.t. Sfi^i -\- hfjmXji -\- Sn-\-l — . 

We can rewrite Eq. (|9} to have a form clearer for computing 

Lmlii^n) = minr^_i(s„_i) +r^,i(-(s„_i + hmnX„)) ■ 

Sn-l 

(10) 

For GF{q),q = 2™, Eq. JTol can be simpHfied further to 

-^m«(2;n) = minr,^_i(s„_i) +r^, i(s„_i + /im„a:„) . (11) 

Sn-l 

When n = N, the result is 

^rn.Ni^N) = -li-hmNX n) ■ (12) 

When n — 1, the result is 

Llt]iixi)^r^-hhM) . (13) 

D. Computational Complexity 

At each iteration, the vertical scan of the generalized 
(normalized/offset) min-sum algorithm has the computational 
complexity of 0{Ndyq), where is the average variable 
degrees. 

For each constraint (check node), the dynamic programming 
horizontal scan carries 0{dc{m)q^) minimization operations 
and the same number of addition operations. dc{m) here is the 
degree of the mth check node. In total, the complexity of the 
horizontal scan is 0{Mdcq^), where dc is the average check 
node degrees. 

If we reduce the number of candidate symbols for each 
variable from q to n„i best candidate symbols, the complexity 
of the horizontal scan is 0{Mdcnmq)- The complexity of the 
horizontal scan of the algorithm proposed in [5] is 0{Mdcq^). 
If rim is small compared to q, the complexity of our algorithm 
can be remarkably reduced. For example, for codes over 
GF{2hQ), we reduced q — 256 to Um = 16 without noticing 
much degradation in performance in our experiments. In this 
case, the complexity of the dynamic programming horizontal 
scan is reduced by factor 16. Nevertheless, such a speedup can 
cause degradation in performance of the decoding algorithm if 
n,n is too small compared with q. Furthermore, the degree of 
the degradation could vary from one code structure to another 
code structure. 
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Fig. 1. The bit error rates (BER) of decoding a GF(4) LDPC code and a 
GF{8) LDPC code using the standard sum-product algorithm (SPA) and our 
algorithm (COD). 

III. Experimental Results 

We have used the two LDPC codes offered by Davey and 
Mackay in [13] to evaluate the performance of the generalized 
min-sum algorithm with the dynamic programming horizontal 
scan. The first code is defined over GF{4) of a code length 
9, 000 and the second is over GF{8) of a code length 6, 000. 
The code rates of the both codes are 1/3. 

In our simulation, we use BPSK modulation and AWGN 
(additive White Gaussian Noise) channel. Figure ^ shows the 
performances of the normalized min-sum algorithm (COD) 
with the dynamic programming horizontal scan and the sum- 
product algorithm (SPA) at decoding both the codes. The 
factor a used by the normalized min-sum algorithm is 0.865 
for the code over (S'F(4) and 0.820 for the code over GF{8). 
The normalized min-sum algorithm is a special case of a newly 
discovered optimization method called the cooperative opti- 
mization (see [14], [15]). The maximum numbers of iterations 
for both the algorithms are all set to 300. 

From the figure we can see that the performances of the 
normalized min-sum algorithm are very close to those of the 
sum-product algorithm. The former is only around 0.05 dB 
away from the latter at decoding the GF{4:) LDPC code. 
The degradation increases to 0.1 dB for the GF{8) LDPC 
code which is still negligible. The (normalized/offset) min- 
sum algorithm uses only additions and minimizations in its 
computation. The SPA in its computation uses addition opera- 
tions and expensive multiplication operations. The SPA in the 
log domain is a little bit more complex in computation than the 
COD for software implementations due to the table looking 
up operations, which are expensive for parallel hardware 
implementations. Furthermore, the min-sum algorithm does 
not dependent on the channel estimate while the sum-product 
algorithm needs to estimate the variance of the channel noise. 
The inaccuracy in the channel estimate can lead to noticeable 



performance degradations of the sum-product algorithm. 

IV. Conclusion 

We have presented in this paper a general (normal- 
ized/offset) min-sum algorithm for decoding LDPC codes over 
any Galois field GF{q), q > 2. To speed up the horizontal 
scan of the algorithm, the dynamic programming technique 
has been applied. At each iteration, the computational com- 
plexity of the vertical scan of the algorithm is 0{Ndyq) 
and the computational complexity of the horizontal scan is 
0{Mdynmq), nm < q- In our experiments, compared with 
the belief propagation algorithm, the generalized min-sum 
algorithm with the dynamic programming horizontal scan has 
only around 0.1 dB degradation in performance at water fall 
regions. It is suitable for hardware implementations because 
it is simple in computation and uses only minimization and 
addition operations. 
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